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Abstract 

We propose to use bifurcation theory and pattern formation as theoretical probes for various hypotheses 
about the neural organization of the brain. This allows us to make predictions about the kinds of patterns 
that should be observed in the activity of real brains through, e.g. optical imaging, and opens the door 
to the design of experiments to test these hypotheses. We study the specific problem of visual edges and 
textures perception and suggest that these features may be represented at the population level in the 
visual cortex as a specific second-order tensor, the structure tensor, perhaps within a hypercolumn. We 
then extend the classical ring model to this case and show that its natural framework is the non-Euclidean 
hyperbolic geometry. This brings in the beautiful structure of its group of isometries and certain of its 
subgroups which have a direct interpretation in terms of the organization of the neural populations 
that are assumed to encode the structure tensor. By studying the bifurcations of the solutions of the 
structure tensor equations, the analog of the classical Wilson and Cowan equations, under the assumption 
of invariance with respect to the action of these subgroups, we predict the appearance of characteristic 
patterns. These patterns can be described by what we call hyperbolic or H-planforms that are reminiscent 
of Euclidean planar waves and of the planforms that were used in [18, 19] to account for some visual 
hallucinations. If these patterns could be observed through brain imaging techniques they would reveal 
the built-in or acquired invariance of the neural organization to the action of the corresponding subgroups. 

Author summary 

Naive introspection conveys to us the vivid feeling that our visual perception of the outside world is 
remarkably stable and invariant despite the fact that we move our gaze and body. This must be the effect 
of the neuronal organization of the visual areas of our brains that, despite the high variability of the flux 
of photons impinging on our retinas, manage to maintain in our consciouness a representation that seems 
to be protected from brutal variations. In this article we propose a theory to account for an invariance 
that pertains to such image features as edges and textures. The theory is based on the simple assumption 
that the spatial variations of the image intensity, also called its derivatives, are extracted and represented 
in such brain areas as the hypercolumns of VI by populations of neurons that excite and inhibit each 
other according to the values of these derivatives. Geometric transformations of the retinal image, caused 
say by eye movements, affect these derivatives and their neuronal representations. Assuming that these 
representations are invariant to these transformations we predict the appearance of some specific patterns 
of activity which can be described by what we call hyperbolic planforms. These hyperbolic planforms 
correspond to the usual planar waves or planforms that have been used in [18, 19] to account for some 
visual hallucinations, and arise naturally from our assumptions about the way the image derivatives are 
represented in neural populations and about their invariance to some retinal transformations. It is a 
surprising feature of our work that the natural geometry that emerges from our work is not the usual 
Euclidean geometry we are all used to but the much less familiar hyperbolic, non-Euclidean, geometry 
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that was made famous by the work of Lobatchewsky. We also propose some preliminary ideas for putting 
our theory to test by actual measurements of brain activity. 

Introduction 

Visual perception, computational or biological, depends upon the extraction from the raw flow of images 
incoming on the retina of a number of image features such as edges, corners, textures or directions of 
motion, at a variety of spatio-temporal scales. All these features involve comparing some functions of 
the incoming intensity values at nearby spatio-temporal locations and this points very strongly to the 
notion of derivatives. The idea of constructing the image representations from various derivatives of the 
intensity flow is at the heart of the concept of the primal sketch put forward in the seventies by the 
late David Marr [54] or the concept of fc-jets borrowed from mathematics by Jan Koenderink and his 
colleagues [50, 30]. A quick look at the computer vision or image processing literatures will convince 
anyone of the universal use of image derivatives in feature extraction algorithms [60, 5, 40, 31] . There 
is also strong evidence that the visual system of many species is organized in such a way that quantities 
related to image derivatives are extracted, and hence represented, by neuronal activity [21]. The notion 
of derivative is misleading though because it often implies in people's minds the idea of linearity. But 
of course it does not have to be the case, computer vision algorithms are usually highly nonlinear even 
if they use derivatives, and nonlinearities are omnipresent in the brain and in the parts of it that are 
dedicated to visual perception. 

If we accept these two ideas, 1) that image derivatives are represented in the visual pathway and 
2) in a nonlinear fashion, this immediately raises the related questions of the coordinate system(s) in 
which they are represented and the effect of changing such coordinate system(s). Changes of coordinate 
systems are described by group actions such as those of the familiar groups of translations and rotations 
in the Euclidean plane. This leads naturally to the idea of group invariance: one can argue that the 
image features representations should be somewhat robust to these groups actions. This is of course 
only a hypothesis albeit a likely one, we think. In computer vision this idea is not new and there 
was a time when a significant part of this community was actively designing feature representations 
that were invariant with respect to a variety of group actions [ ]. What is interesting in the case of 
biological vision is that this hypothesis has consequences that may be testable experimentally: If the 
visual pathway is organized so as to support invariance of feature representations at the mesoscopic level, 
say the hypercolumn in VI, we may be able to predict the appearance of certain patterns of activity in 
the involved neuronal populations that are a direct consequence of the invariance hypothesis. 

In this article we begin the development of a mathematical theory of the processing of image edges 
and textures in the hypercolumns of area VI that is based on a nonlinear representation of the image 
first order derivatives called the structure tensor. Assuming that this tensor is represented by neuronal 
populations in the hypercolumns of VI that interact in a way that can be described by equations similar to 
those proposed by Wilson and Cowan [04] , bifurcation theory allows us to predict the formation of specific 
patterns in the cortical medium that are related to the assumed invariant properties of the underlying 
cortical representation of the structure tensor. 

Methods 

The structure tensor as a representation of edges and textures 

The structure tensor is a way of representing the edges and texture of a 2D image I(x,y) [9, 49]. Let 
g (7l (x, y) = 2 la\ ex P(~( x2 + y 2 ) /2f f) be the two-dimensional Gaussian function with mean and variance 
erf . We consider the regularized image I ai obtained by convolving the image / with g ai , we note I ai = g ai * 
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I, where the symbol * represents the convolution operation. The gradient V/ CTl of I ai is a two-dimensional 
vector which emphasizes image edges: within a flat region V/ CTl = 0, at a pronounced edge ||V/ CTl ||, the 
Euclidean norm of V/ CTl is large, and V/ CTl points in the normal direction of the edge. The parameter o\ is 
called the local scale. One then forms the 2x2 symmetric matrix T (\7I ai ) = V/ CTl ® V/ CTl = V/^ t VI rTll 
where <g> indicates the tensor product and * indicates the transpose of a vector. By convolving T (\7I ai ) 
componentwise with a Gaussian g a2 we obtain the matrix T a2 (VI ai ) = g a2 -kT (VI ai ). It is not hard to 
verify that this symmetric matrix is positive, i.e. t z r T (J2 (\i 'I ai ) z > for all vectors z in R 2 . It is called 
the structure tensor. When there is no ambiguity we will use T instead of T a2 (\7I ai ). 

Note that the construction of the structure tensor involves two spatial scales. The first one, defined 
by <7i, is the one at which the image derivatives are estimated. The structure tensor is insensitive to noise 
and irrelevant details at scales smaller than a\. The second one, defined by cr 2 , is the one at which the 
averages of the estimates of the image derivatives are computed, it is the integration scale, and is related 
to the characteristic size of the texture to be represented, and to the size of the receptive fields of the 
neurons that may represent the structure tensor. 

Being symmetric and positive, T has two orthonormal eigenvectors ei and e 2 and two positive cor- 
responding eigenvalues Ai and A 2 which we can always assume to be such that Ai > A2 > 0. The 
distribution of these eigenvalues in the (Ai, A 2 ) plane reflects the local organization of the image inten- 
sity variations. Indeed, one can establish a correspondence between local intensity patterns and relative 
values of Ai and A 2 . For example constant areas are characterized by Ai = A 2 = 0, straight edges give 
Ai » A 2 ~ 0, their orientation being that of e 2 , corners yield Ai > A 2 » 0. The difference Ai — A 2 
becomes large for anisotropic textures. These simple examples are intended to show the richness of the 
structure tensor when it comes to representing textures and edges at a given spatial scale. 

This representation of the local image orientations and textures is richer than, and contains, the local 
image orientations model which is conceptually equivalent to the direction of the local image intensity 
gradient g„ 2 *V/ CTl . The local image orientation is a one-dimensional representation which can be obtained 
from the local image intensity gradient, which is two-dimensional, as the ratio of the gradient components. 
The structure tensor itself is three-dimensional. Its three dimensions can be either pictured as its three 
entries or as the collection of its two eigenvalues and the direction of one of its eigenvectors, e.g. the 
one corresponding to the largest eigenvalue. In particular, it should be clear from the above that the 
structure tensor can discriminate local intensity patterns that would be otherwise confused by the local 
orientations model: For example, given an isotropic structure localized in an image neighbourhood of 
size of the order of the integration scale er 2 with no preferred direction of gradient, the local gradients 
average out resulting in a zero magnitude. An example of such an isotropic structure is a black disk 
of diameter cr 2 /2 on a white background. There is clearly gradient information; however, since there is 
no preferred phase, it zeros itself out as in the case of a uniformly grey pattern. The eigenvalues of the 
structure tensor turn out to be both equal to some strictly positive number in the case of the disk and 
both equal to in the case of the uniformly grey pattern. This is an extreme example but one may 
also think of a texture pattern made of short line elements pointing in roughly the same direction. The 
local gradients average to a direction roughly perpendicular to the average direction of the line elements. 
The length of the resulting vector is an indication of the average contrats across these line elements. In 
the case of the structure tensor, the unit eigenvector, together with its corresponding largest eigenvalue, 
contains the same information but the second eigenvalue contains information about the spread in the 
directions of the line elements, the difference between the two eigenvalues being, as mentioned above, an 
indication of the anisotropy of the texture. This discussion should have made it clear that the structure 
tensor contains, at a given scale, more information than the local image intensity gradient at the same 
scale. 

The question of whether some populations of neurons in such a visual area as VI, can represent the 
structure tensor cannot be answered at this point in a definite manner but we hope that the predictions of 
the theory we are about to develop will help deciding on this issue. We can nonetheless argue as follows. 
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We know that orientation hypercolumns in VI represent local edge orientations in receptive fields whose 
size vary between 0.5 and 2 degrees. This corresponds to values of o-i between 0.5 and 2 centimeters at a 
viewing distance of 57 centimeters. For a given orientation 8. the two orientations 8 + 7r/4 and 8 + n/2 
are also represented in the orientation hypercolumn and this is very much the same as representing the 
three components of the stucture tensor at this scale. Indeed, let us denote by Vl£ the component 

of the smooth gradient in the directions 8. It is easy to show that VI®^^ 4 = ^ \^I^ X + Vl^* - ^ 2 ^ 
and it follows that the product Vi^ Vi^ - *^ 2 is a linear combination of (VI^) 2 , (vi^*^} > an d 

^V/ct^^ 2 ^ ■ This remains true of the local averages of these quantities obtained by convolution with 

the Gaussian of standard deviation a%. We note that these three components are represented in the 
Euclidean coordinate system defined by the orientation 8 and the orthogonal direction 8 + ir/2. So we 
may say that the joint activity of the populations of neurons in the hypercolumn representing these three 
orientations is in effect an encoding of the structure tensor. This reasoning applies to any orientation 
8 and it follows that the joint activity of all triplets of populations of neurons in the hypercolumn that 
encode the triplets of orientations (8, 8 + tt/2, 8 + tt/4) for all possible values of 8 between and ir are 
a representation of the structure tensor that is roughly invariant to the choice of the orientation of the 
coordinate system in which it is represented or more accurately that contains all such representations 
which differ by a rotation of the coordinate system, up to the accuracy of the orientation representation 
in the orientation hypercolumn. Where in VI could one find populations of neurons that encode the 
structure tensor? Cytochrome oxydase (CO) blobs and their neighbourhoods seem to be good candidates 
since their distribution appears to be correlated with a number of periodically repeating feature maps 
in which local populations of neurons respond preferentially to stimuli with particular properties such 
as orientation, spatial frequency, brightness and contrast [10, 11, 12, 13, 44, 47, 20]. It has thus been 
suggested that the CO blobs could be the sites of functionally and anatomically distinct channels of visual 
processing [24, 52, 62, 63]. Recently Bressloff and Cowan [15, 14] introduced a model of a hypercolumn in 
VI consisting of orientation and spatial frequency preferences organized around a pair of pinwheels. One 
pinwheel is centered at a CO blob and encodes coarse to medium coarse scales, the other is centered at 
a region that encodes medium coarse to fine scales. Despite the fact that these authors do not consider 
the encoding of brightness and contrast, it has been suggested by other authors [1] that this might also 
be the case. Such a hypercolumn is therefore a good candidate for representing the structure tensor at 
several scales as well as, as these authors claim, the local orientations at various spatial frequencies. As 
a consequence of this discussion we assume that the structure tensor is represented by the activity of the 
populations of neurons in a hypercolumn, where the word represented is to be understood as explained 
above. 

Let therefore T be a structure tensor. We assume that there is some quantity which we associate to 
an average membrane potential, noted V(T, r), and is a function of T and the time r abd which is, e.g., 
high if T reflects the actual intensity values in the column receptive fields and low otherwise. We assume 
that its time evolution is governed by an equation of the Wilson and Cowan [64] or Amari [ ] type. 

V T (T, t) = -aV(T, r) + / w(T, T')S(V(T', r)) dT' + 7(T, r), (1) 

JH 

where the integral is taken over Ti, the set of possible structure tensor. We provide below a precise 
mathematical definition of this set. dT' is the corresponding area element, also defined below, and I is 
an input current. 

The positive coefficient a can be normalized to 1 by a suitable choice of time scale. S is a sigmoidal 
function which after normalization may be expressed as: 



(2) 
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where fi is a positive coefficient which governs the stiffness of the sigmoid. 

The function w. called the connectivity function, is defined as follows. If we assume further that 
the neuronal population representing the value T of the structure tensor excites (respectively inhibits) 
the neuronal population representing the value T' if the distance d(T,T') is small (respectively large), a 
natural form of the connectivity function w is obtained from the following function g, a difference between 
two pseudo-Gaussians: 

f_M f_M 

g(x) = i e 2(7 i - 9 -L e 2a l , (3) 

where <j\ < 02, < 1, and / is a monotonously increasing function from the set K + of positive real 
numbers to M. + . For example, if f(x) = x 2 we obtain the usual difference of Gaussians. 
One then defines 

w(T,T')=g(f(d(T,T>))) 
w is clearly invariant to the action of the isometries 7 of H: 

10(7 -T, 7 -T') = w(T,T') V 7 

We will see that with such a choice of connectivity function, the integral in (1) is well-defined because w 
is small at "infinity" . 

This is similar in spirit to the ring model described in [38, 25], see the Discussion Section. 

There are of course many loosely defined terms in the presentation so far, including the definition 
of the set of structure tensors, of the distance between two such tensors that plays a central role in the 
construction of the connectivity function w, and the definition of the isometries of the set of structure 
tensors, i.e. the transformations that leave the distance between two tensors unchanged. We provide 
below precise answers to all these questions. Before doing this we explain how equation (1) which 
describes the dynamics of a neural mass, e.g. a hypercolumn of VI, can be "spatialized" in order to 
provide a neural or cortical field model (see [23, 25] for reviews of neural fields) that could describe the 
spatio-temporal activity of VI related to the representation of edges and textures. 

Indeed let us assume the existence a continuous distribution of such columnar systems in a regular 
bounded open set f2 of M 2 , modeling a piece of a flat cortex. We note r the spatial variable. Equation 
(1) can be generalized to the following 

V t (t,T,t) = -V(t,T,t)+ [ [ w{T,T,T , i r)S(Y{T',r,T))dT , dc' +I(t,T,t), (4) 

Jn Jh 

where dr' is the usual Euclidean area element. The average membrane potential V depends on the 
position r in the continuum, i.e. on the position of the hypercolumn in VI, on the time r and on the 
possible local values of the structure tensor T. The connectivity function w is now a function of the 
structure tensors T at point r of the continuum and T at point r'. 

We do not deal any further with this equation, leaving it for future work. 

Considering equation (1) we will study how its solutions change when the slope parameter u. increases 
from the value 0. This study, together with the formulation of hypotheses about the invariance of the 
average membrane potential with respect to the action of some subgroups of the group of isometries of the 
set of structure tensors, predicts, through bifurcations of the solutions to (1), the appearance of certain 
patterns displaying the kind of symmetries described by these subgroups. If such patterns can indeed be 
observed by actual measurements, e.g., optical imaging [37], then this would be a strong indication that 
the neural "hardware" is built in such a way that its state is insensitive to the action of these subgroups. 
To say things differently, bifurcation theory and pattern formation could potentially become theoretical 
probes for the validity of various hypotheses about the neural organization of the brain, allowing to make 
predictions about the kinds of patterns that should be observed in the activity of real brains, and opening 
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the door to the design of experiments to test these hypotheses. This is indeed an exciting perspective. 
We now proceed to flesh up the theory. 

The mathematical structure of the set of structure tensors 

We present some important properties of the set of structure tensors. These properties are somewhat 
scattered in the literature and are relevant to our forthcoming discussion of pattern formation in cortical 
tissues. 

The key observation is that the structure tensors naturally live in a hyperbolic space of dimension 
3 that can be peeled, like an onion, into sheets of dimension 2, each sheet corresponding to a constant 
value of the determinant of the elements inhabiting it. We are therefore led to study hyperbolic spaces 
of dimension 2 which turn out to enjoy a very simple representation in the open unit disk D of the 
complex plane, the so-called Poincare disk, with its fascinating non-Euclidean geometry that arises from 
the Ricmannian structure of the set of structure tensors. This geometry has been studied in depth by 
mathematicians and theoretical physicists and is still a very active research area with many open difficult 
questions. We then establish the dictionary that will allow us to translate statements about the structure 
tensors of determinant equal to one into statements about complex numbers of magnitude less than or 
equal to 1. The fundamental new item in this section is the group of isometries of the Poincare disk, 
analog to the group of rigid displacements in the Euclidean plane, whose action on complex numbers 
can be translated (the technical word is lifted) into meaningful actions on structure tensors. We explain 
in the supplementary text SI how to put things back together, that is to say, how to reconstruct in 
a mathematically coherent fashion the onion representing the whole set of structure tensors from the 
description of one of its sheets, or peels, i.e. the one corresponding to the unit determinant structure 
tensors. The final touch is a somehow deeper analysis of some subgroups of the group of isometries of 
D introduced previously. These subgroups arise naturally when one examines the kinds of invarianccs 
that the cortical representations of the structure tensors should enjoy The mathematical structure that 
emerges in this context is that of a Fuchsian group, introduced by Henri Poincare in 1882 [59]. 

Consider the set SDP(2) of 2 x 2 symmetric positive-definite matrices (see glossary in table 1). Indeed, 

let 

, a>0, ab-c 2 >0 (5) 

be an element of SDP(2). 

We refer to a (respectively &, c) as the a-coordinate (respectively the b- c-coordinate) of T. 

If we scale T by A > 0, AT is also an element of SDP(2). Hence SDP(2) is a positive cone. It is open 
because it is defined by two strict inequalities. 

It is also a three-dimensional Riemannian manifold in which the distance is defined as follows [55] . 
Given Ti and T 2 in SDP(2), the Riemannian distance do(Ti,T 2 ) can be expressed as the Frobenius norm 1 
of the principal logarithm of T^ X T 2 : 

d (T u T 2 ) = HlogTf 1 ^ = (j2 log 2 A 4 j , (6) 

where the A^s are the eigenvalues of the matrix T^ 1 T 2 . This expression is symmetric with respect to Ty 

and T 2 since T 2 ~ 1 T 1 = (T^ 1 T 2 ) 1 and the A^s are positive since T X _1 T 2 is conjugate to the symmetric 

positive definite matrix T2 T^T^ . 

This definition of the distance between two tensors can be motivated from a biological viewpoint. A 
tensor is a symmetric 2x2 matrix, hence it can be thought of a a three-dimensional vector (a, b, c). The 



T = 



a c 
c b 



lr The Frobenius norm of a real matrix is the square root of the sum of the squares of its elements. 
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"natural" distance between two such vectors (representing the tensors T\ and T 2 ) is the usual Euclidean 
distance (ai — a 2 ) 2 + (&i — b 2 ) 2 + (ci — C2) 2 . This distance has the following problem. A tensor 7" defines 
a quadratic form z — >' zTz. If we change the coordinate system in which we express the coordinates of 
two tensors T\ and 72 they become t MT\M and l MT 2 M, where M £ GL(2,M) is the matrix defining 
the change of coordinate system. It can be verified that this transformation does not leave in general 
the Euclidean distance invariant whereas it does leave do invariant. This invariance is a very desirable 
feature since the measure of similarity between two tensors (their distance) should not depend on the 
particular coordinate system used to evaluate their components. Hence it is very likely that evolution 
would rather select do than the simpler but sometimes misleading Euclidean distance. 

From yet another perspective it can be shown, see e.g. [32, Volume 1, Chapter X, Theorem 9], that 
there exists a change of coordinates, i.e., a 2 x 2 matrix Z such that in the new coordinate system 
*ZT 2 Z = diag(Ai, A2) and l ZT\Z = ld 2 . In other words, the distance (6), is a measure of how well 71 
and 72 can be simultaneously reduced to the identity matrix by a change of coordinate system. This 
change of coordinate system is not in general a pure rotation but a combination of a pure rotation and a 
scaling of the coordinates. If we picture the structure tensor 7" as the elliptic blob defined by the equation 
t zTz < 1, z — (x,y), the two tensors 71 and T 2 are represented by two elliptic blobs as shown in the 
lefthand part of figure 1. After the coordinate transform defined by Z, T\ is represented by a unit disk 
and T 2 by an elliptic blob whose major axes arc the eigenvalues Ai and A2 that appear in (6), as shown 
in the righthand part of the same figure. There is a unique geodesies (curve of shortest length) between 



Figure 1. The two structure tensors 71 and 72 are represented by the elliptic blobs shown 
in the lefthand side of the figure. After the change of coordinates defined by the matrix Z, 
Ti is represented by the unit disk and the principal axes of 72 are equal to the eigenvalues 
Ai and A2 that appear in (6), see text. 

two elements of SDP(2). Its expression is given in the supplementary text material S3. 

If we now consider the two-dimensional submanifold SSDP(2) of the special positive definite matrixes 
whose determinant ab — c 2 is equal to 1, it is clear that SDP(2) = SSDP(2) x R + . We detail this point 
in the supplementary text material SI. 

It can be shown that SSDP(2) equiped with the Riemannian metric induced by that of SDP(2) is a 
Riemannian surface with constant sectional curvature equal to -1, see the supplementary text material 
SI for details. This indicates that it is isomorphic to the two-dimensional hyperbolic space, noted H 2 , 
for which we now provide three different models. 

There are three main models of i7 2 , the two-dimensional hyperbolic space. Each model has its 
advantages and disadvantages. We first present the hyperboloid model which is the most natural for 
the set of structure tensors, next the Poincare disk model which is the most convenient for carrying out 
analytic computations. We relegate in the supplementary text material S2 the third model, called the 
Poincare half-plane model and noted Ti., which is not as convenient as the second for visualizing important 
geometric transformations such as rotations. 




z T r 2 z 



z 
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The hyperboloid model is defined as the hyperboloid sheet in M 3 of equation 

Xq — x\ — x\ = 1, xq > 0, 

associated to the quadratic form q(x) 2 which yields by polarization the bilinear form 

b(x,x f ) — xqXq — x\x' Y — x 2 x' 2 . The corresponding Ricmannian distance is given by 

d\{x,x') = arccosh b(x, x'). 

Geodesies are the curves intersections of the hyperboloid sheet with planes through the origin. 

The Poincare disk model is conveniently obtained by stereographic projection on the plane of equation 
x = through the point of coordinates (—1,0,0) of the hyperboloid model. This establishes a one to 
one mapping of the hyperboloid sheet onto the open unit disk D. Given two points z and z' of D 
corresponding to the points x and x' of the hyperboloid, the corresponding Riemannian distance is given 
by 

\z - z'\ 

d 2 {z, z') = arctanh- =~jti (?) 

|1 — zz | 

and satisfies d 2 (z, z') — di(x,x'). We may also write 

a i <\ 1 ^ \l-zz'\ + \z' -z\ 

d ^ Z) =2 l ° S \l-zz>\-\zi-z\ (8) 

Geodesies in D are either diameters of the unit circle or circular arcs orthogonal to it. 
The surface clement in D is given by 

dzdz 

ds 



(i-W 

In the rest of the paper we use the Poincare disk model. This is a subjective choice essentially driven 
by the fact that this model exhibits in an obvious manner the rotational symmetry of the hyperbolic 
plane. 

We now detail the relationships between SSDP(2) and its representation in the Poincare unit disk D. 
We also describe how the action of the direct isometries of D on this representation lifts to SSDP(2). 
This is important since it allows us to give an interpretation in terms of image-based operations, hence 
biological and computational, of the action of an isometry in D. This will turn out to be most important 
in the sequel. 

A unit determinant structure tensor T is a 2 x 2 symmetric positive definite matrix defined by (5) 
and satisfying ab — c 2 = 1. This implies a + b > 2 because a + b > 2\fab = 2\/l + c 2 . The linear change 
of variables 

a + b a — b 

xa = — ^ = — ^ x 2 = c (9) 

establishes a one to one mapping from the set of structure tensors to the hyperboloid model of H 2 
from which we deduce the correspondences with the Poincare disk D. The corresponding point in D is 
represented by the complex number 

(a-b + 2ic). (10) 



2 + a + b 
z satisfies 

n . | | a + b-2 

< \z = , < 1. 

~ 1 1 a + b+2 

We note Tr the trace a + b of T. This shows that the border of D, the unit circle, corresponds to the 
tensors such that Tr — > co. 
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Conversely, given a complex number z = Z\ 
coordinates are given by 



-iz-i representing a point of D, the corresponding tensor 



b = 



{i+zif+4 

l-z'f-z'i 
(l- Zl ) 2 +zj 
l-zl-zl 

\-zi-zi 



(11) 



Note that equation (10) is the "Tensor to D dictionary" that allows us to translate statements about 
structure tensors to statements about points in the unit disk and equations (11) are the "D to Tensor" 
dictionary. 

Also note that we have 

d (T,T') = di(y,y') = d 2 {z,z') = d 3 (u,u') 

for all pairs (T, T') of unit determinant structure tensors represented by (y, y') in the hyperboloid model, 
(z,z r ) in the Poincare disc model, and (u,u') in the Poincare half-plane model (see supplementary text 
material S2). In particular, the distance (6) defined between two structure tensors is equal to the Hyper- 
bolic distance between their representations in the Poincare half-plane or unit disk. 

We now describe the isometries of D, i.e. the transformations that preserve the distance d 2 - Here 
again we recall some basic facts, now focusing on the hyperbolic geometry of the Poincare disc. We refer 
to classical textbooks in hyperbolic geometry for details, e.g., [48]. The direct isometries (preserving 
the orientation) in D are the elements of the special unitary group, noted SU(1, 1), of 2 x 2 Hcrmitian 
matrices with determinant equal to 1. Given 2 
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a (3 
P a 



such that |a| 2 - \/3\ 2 = 1, 



an element of SU(1, 1), the corresponding isometry 7 in D is defined by 

■(3 



az - 
7 • z = — 



(3z- 



zeD 



(12) 



Orientation reversing isometries of D are obtained by composing any transformation (12) with the re- 
flection k : z 1 y ~z. The full symmetry group of the Poincare disc is therefore (see table 1) 

U(l,l) =SU(1,1)Uk-SU(1,1). 

The action of the group SU(1, 1) on the Poincare disc D, is equivalent to the conjugation on the set of 
structure tensors. We call it the lifted action of SU(1, 1) to the set of structure tensors. Indeed, let 



7 = 



a (3 
(3 a 



, a = oti + ia.2, P — Pi + ifii 



be an element of SU(1, 1), whose action on D is given by (12), then it can be shown by an easy computation 
that the lifted action on the corresponding structure tensor T is 



where 



Oil 

P2- 



■ Pi OL 2 
OL2 Oil 



P2 
Pi 



e SL(2,R). 



(13) 
(14) 



'2 indicates the complex conjugate of the complex number z. 
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Equation (13) is important. It shows that the "lifted" action on a given structure tensor T of an isomctry 
7 of D is simply a change of coordinates 7 in the image plane, where the relation between 7 and 7 is 
given by equation (14). We show below that these changes of coordinate systems have very simple 
interpretations for many of the subgroups that generate SU(1, 1). 

Because isometries are conformal maps, they preserve angles. However they do not transform straight 
lines into straight lines. Given two points z ^ z' in D 7 there is a unique geodesic passing through them: 
the portion in D of the circle containing z and z' and intersecting the unit circle at right angles. This 
circle degenerates to a straight line when the two points lie on the same diameter. Any geodesic uniquely 
defines the reflection through it. Reflections are orientation reversing, one representative is the complex 
conjugation k (reflection through the geodesic K): k ■ z — z. 

Let us now describe the different kinds of direct (orientation preserving) isometries acting in D. 
Thanks to (13), they induce some interesting lifted actions on the set SSDP(2) of structure tensors that 
we also describe. We first define the following one-parameter subgroups of SU(1, 1): 



Definition. 







{r<p = 


f n 






K = 




e -^/ 2 




A = 


{a t = 


cosh t sinh t 


< 


sinh t cosh t 




N = 


{n s = 


1 + is —is 






is 1 — 










is 


Note that r v ■ z — e %(p z for z £ D and also, • = tanh(t) 


"boosts" in the theoretical Physics literature 


[ 


]. The corresp 


according to (14), 




















cos ^ 


sin 






f v = 




in 

-sm| 


cos 










' e* 






< 


a t = 




e~* 












1 ' 








h s = 




-2s 1 





t e 



s e 



are, 



£ 
2 

se 
2 



(15) 



They generate three subgroups, noted K, A and N, of SL(2, 
decomposition, see [45]). 



I) Then the following theorem holds (Iwasawa 



Theorem. 



SU(1, 1) = KAN SL(2, R) = KAN 



This theorem allows us to decompose any isometry of D as the product of at most three elements in the 
groups K, A and N. The group K is the orthogonal group 0(2) which fixes the center O of D. Its orbits 
are concentric circles. The orbits of A converge to the same limit points of the unit circle 3D b±\ = ±1 
when t — > ±00. They are the circular arcs in D going through the points b± and b—\. In particular the 
diameter (6_i, 61) is an orbit. The orbits of N are the circles inside D and tangent to the unit circle 
at b\. These circles are called horocycles with base point b\. Because of this property, N is called the 
horocyclic group. These orbits are shown in figure 2. Any direct isometry which is not ±Id2 (W2 is the 
2x2 identity matrix) falls into one of the following three classes (representatives of which being given 
by elements of K, A and N respectively) : 
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Figure 2. The orbits in the Poincare disk D of the three groups K, A and N. 

(i) Elliptic elements: one fixed point in D; 

(ii) Hyperbolic elements: two (and only two) fixed points on the unit circle; 

(iii) Parabolic elements: one and only one fixed point on the unit circle. 

Let us interpret the meaning of (13) in particular in view of the above definition of the three groups 
K, A, N and equations (15), i.e., what is the corresponding action on the unit determinant structure 
tensor T represented by the point z of D when z is acted upon by the two groups K and A . 

1. The action r v ■ z of an element r v of K on an element z of D lifts to the conjugation r^Tr^ 
of the structure tensor T represented by z. This is equivalent to say that we rotate by ip/2 the 
orthonormal basis (ei,e2) in which the coordinates of T are expressed. 

2. The action at ■ z of an element a t of A on an element z of D lifts to the conjugation ajTa t of the 
structure tensor T represented by z. This is equivalent to saying that we scale the first vector of 
the orthonormal basis (ei, e2) in which the coordinates of T are expressed by e and the second by 
e"*. 

At this point the reader may wonder what is the biological an/or computational relevance of imposing 
on the structure tensors the constraint that their determinant be equal to 1. This is indeed a somewhat 
unnatural assumption. In the supplementary text material S3 we propose a spherical model of the whole 
set, SDP(2), of structure tensors that is obtained by piecing together into a sphere the scaled Poincare 
disk models of each subset of structure tensors of constant determinant. Because of this model we can 
restrict, without loss of generality, our attention to the set SSDP(2) of unit determinant structure tensors. 

A question which will be important in our subsequent analysis of pattern formation is that of the 
periodic tilings of the hyperbolic plane, i.e., the existence of a compact domain F of D and of a discrete 
subgroup r (a so-called Fuchsian group [ ]) of the isometry group of D, such that 4 

(i) F n (7 • F) = for all 7 6 T, 7^ Id 

(ii) D=\J 7 -F 

yer 

Such an F is called a fundamental domain for T which is furthermore called co-compact if F is compact. 
This property is relevant to the upcoming discussion about the eigenvalues and the eigenfunctions of the 
restriction to their Dirichlet regions of the Laplace-Beltrami 5 operator. 

This definition is similar to the one which holds for the discrete subgroups of the isometry group, 
noted E(2,R), of the Euclidean plane. It is well-known that periodic tilings of the Euclidean plane are 

3 There is no corresponding intuitive interpretation for the horocyclic group N. 
4 F is the interior of the closed set F, i.e. the largest open set included in F. 

5 The Laplace-Beltrami operator is the generalisation of the Laplace operator to operate on functions defined on surfaces, 
or more generally on Riemannian manifolds. 
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associated with lattice subgroups of the translation group R 2 , i.e. discrete subgroups T defined by a vector 
basis (e 1; e 2 ) and T = {mei + ne 2 , (m, n) S Z 2 }. The maximal subgroup of 0(2) which leaves the lattice 
invariant is called the holohedry of the lattice. If ||ei|| = ||e2||, the only possibilities are when these two 
vectors make a right angle (square lattice, holohedry D4), an angle equal to ir/3 or 2ir/3 (hexagonal lattice, 
holohedry D§), or an angle different from those ones (rhombic lattice, holohedry D2). A "degenerate" case 
is when any period is allowed in one direction, in other words T = {mei+ye2, e 2 _L ei, (m, y) S ZxR}. In 
this case the fundamental domain is non compact and fills a "strip" between two parallel lines orthogonal 
to e! and distant of length ||ei||. Since the quotient R 2 /Z 2 is a torus, harmonic analysis for functions 
which are invariant under the action of T reduces to Fourier series expansion for bi-periodic functions in 
the plane. 

In the hyperbolic case the problem is more complex. The reason is that the Euclidean plane, which 
can be viewed as the symmetric space E(2,R)/0(2), is an Abelian group, while the Poincare disc D ~ 
SU(1, 1)/S0(2) is a symmetric space but has no such group property. It was shown by Poincare in 1880 
that any regular polygon 6 in D generates a periodic tiling by acting recursively with reflections along the 
edges of the "tiles" [48] . 

Harmonic analysis for T-invariant functions in D is difficult and relies upon the theory of modular 
functions and associated concepts (see [33, 45]). 

One special and important case for our purpose is the following. Let us consider the horocycle, noted 
£o ; with base point b\ € dD and passing through the center O of D. Let £t be the image of £0 under 
the hyperbolic transformation at (see the definition above), i.e. the circle tangent to dD at b\ and going 
through the point at ■ O. The map t G R i— > at is a group homomorphism. Therefore, given T > 0, the 
set {a„T, n G %\ is a discrete subgroup of the group A whose fundamental (non compact) domain is 
delimited, for example, by the horocycles £0 an d £t- This "croissant" shaped domain is the analogue the 
"strip" in the Euclidean case. The "lines" perpendicular to the horocycles are the geodesies emanating 
from the point b. Any function in D which is invariant under the action of the horocyclic group N and 
which is "periodic" with respect to a subgroup of A as above, can therefore be developed in Fourier series 
in the variable t. We shall come back to this later in more details. 

Fundamental regions may be unnecessarily complicated, in particular they may not be connected. An 
alternative definition is that of a Dirichlet region of a Fuchsian group. Given two points z and z' of D 
we recall that the perpendicular bisector of the geodesic segment [z, z'\ is the unit geodesic through its 
midpoint (for the hyperbolic distance in D) orthogonal to [2, z']. If z is a point of D which is not fixed 
by any element of a Fuchsian subgroup T — {Id} of SU(1,1) (such points exist according to [48, Lemma 
2.2.5]) the Dirichlet region for T centered at z is the set noted D Z (T) defined by 

D Z (T) = { P eD\ d 2 (p, z) < d 2 ( P , 7(2)) V 7 e r} 

It can be shown that D Z (T) is a connected fundamental region for T, [48, Theorem 3.2.2], that generates 
a periodic tiling of D. 

We noted that the action of K on the set of structure tensors was equivalent to a rotation of the 
Euclidean coordinate system. If we consider the discrete subgroup K n of K (respectively K n of K) 
generated by the rotations of angles tt/u, n e N + . K n is a Fuchsian group because it is obviously 
discrete. It is easy to find a non-compact Dirichlet region for this group showing that it is not co- 
compact. Nonetheless, the quotient group D/K n can be interpreted in terms of retinal properties. An 
element of D / K n is an equivalence class of structure tensors which are the same tensor expressed in 
orthonormal Euclidean coordinate systems that are rotated by multiples of 7r/n with respect to each 
other. This makes perfect sense in terms of a discrete organisation of a visual area as an arrangement of 
such elements as hypercolumns at the vertixes of a periodic (Euclidean) lattice. For example, a square 
lattice corresponds to n — 2 or 4, a hexagonal lattice to n = 6. 



B In fact, the size of the polygon is important as described in a theorem due to Poincare [48, Theorem 4.3.2]. 
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In a similar manner, the action of A is the multiplication of the a-coordinate of the tensor by A = e 2t 
and of the 6-coordinate by 1/A, leaving c unchanged. Remember that a has the interpretation of the 
spatial average of the square of the spatial derivative I x of the image intensity in the x direction, b of the 
average of the square of the spatial derivative I y of the image intensity in the y direction, and c of the 
spatial average of the product I x I y , see figure 3. I x is approximated by the cortical structure by such 
quantities as (I(x + Ax,y) — I(x,y))/Ax, and a similar expression for I y involving a distance Ay. This 
requires that the distances Ax and Ay be known to the neuronal elements something unlikely to happen. 
Their product AxAy has the dimensionality of an area proportional to the average area of the tiles of 
the periodic (Euclidean) lattice formed by the hypercolumns. The action of A on a structure tensor is 
therefore equivalent to changing Ax and Ay while preserving their product, the tile area. 



O 



(x,y + Ay) (x + Ax,y + Ay) 



O 



O 



Ay 



6 



v 



© f,e 2 ' 



e2 = »V e 1 



Ax 



(x + Ax, y) 



■© 



Figure 3. The image plane: the coordinate system (e!,e 2 ) which is used to estimate the 
image derivatives and some of its transformations under the action of some elements of 
T n ,T (see text). 



For a given value T of the real parameter t we note At (respectively At) the cyclic subgroup of A 
(respectively of A) generated by the group clement (respectively clt) • 

We consider the free product' r„^ = K 71 *At of the two groups K n and At- It is an infinite subgroup 
of SU(1, 1). It is generated by the elliptic element r 27r /„ (see equations (15)) and the hyperbolic clement 
Or- Why is this group important? If we consider the quotient group D/T n T an equivalence class z is 
the orbit of z, a point of D, under the action of T r ^T or, equivalcntly, an equivalence class T of the unit 
determinant structure tensor T represented by z under the action of the lifted subgroup T n ,T — K n * At 
of SL(2, R). All tensors in T are representations of the same "intrinsic" tensor in coordinate systems that 
differ only by finite iterations of rotations of ir/n and scalings by e T . In other words this equivalence class 
reflects the kind of geometric "ignorance" that we may expect from the neuronal populations that deal 
with structure tensors. Continuing the analysis, if the group Y n ^T is Fuchsian for some values of T and n 
then we are naturally led to consider one of its fundamental domains or Dirichlet regions. As mentioned 
above it defines a periodic tiling of D which can be used to define functions in D that are invariant with 
respect to the action of T n ^T and hence functions of structure tensors that are invariant with respect to 
the action of T„.t- 



7 The free product of two groups G and G' is the set of "words" composed of "letters" that are elements of G and G' , 
see [51] for details. 
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The question of whether T n> T is a Fuchsian group depends on the respective values of T and n. The 
question has been answered in general for two elements of SU(1,1) [61, 35, 34]. It can be cast as an 
algorithm whose complexity is polynomial [46]. For the values of the rotation angle of interest to us we 
have the following proposition whose proof can be found in supplementary text material S4. 

Proposition. T2.T is a Fuchsian group for all T ^ 0. T^t (respectively Tq^t) is a Fuchsian group if 
coshT > \/2 (respectively if coshT > 2). 

At this point we do not know whether some of these Fuchsian groups are co-compact. 



Results 

The dynamics of equation (1) depends on the input signal I(T,t), the sigmoid function S and the 
connectivity function w(T, T'). In the Poincare disk this equation reads, with a slight abuse of notations 

V T (z,T) = -aV(z,T)+ [ w(z,z')S(V(z',T))dm(z')+I(z,T), (16) 



D 



where z and z' are the representations of T and T and 



dz' dz' 

dm ( z ') = q _ 1 | z /|2)2 Z ' = Z 'l+ iz 2, (17) 



is the Poincare disk model area element. 

We only consider this equation in the sequel. The reader can easily convert all the results to the set 
of tensors using the dictionary previously developed. 

Let us assume from now on that 1 = 0. This corresponds to an isolated set of neural populations, 
which however interact among themselves and may have non trivial states and dynamics. Our aim is 
to analyse this problem from the point of view of the bifurcation from a trivial state. Indeed, assuming 
that a solution V of this equation is homogeneous, meaning that it does not depend upon the structure 
tensor, it follows that the equation to solve reduces to a single real equation of the form 

-V + W S(V) = 

where Wq = J D w(0, z') dm(z'). This equation has a single solution whatever Wo and fx > (see equation 
(2)). We may perform a simple change of coordinates to shift this solution to 0. This is equivalent to the 
choice of a sigmoid function of the form 

««>-ip£L) < 18 > 

in equations (1) and (16), which we will assume in the following. A fundamental property of this new 
equation is that its symmetries are preserved by this change of variables. 

With these choices V = is a solution for all values of Wq and [i. Note that, when fi is small, this 
solution is dynamically stable against perturbations, at least against those which are small in i 2 -norm. 
We may therefore ask what happens when /1 is increased. In order to answer this question we perform a 
bifurcation analysis of the solution of equation (16) with S — So with respect to the parameter ji. 

Hyperbolic waves in the Poincare disc 

We therefore consider equation (16). The next step in the analysis of the bifurcations of its solutions is to 
look at the linearized equation and determine the critical values of the slope fi at which the trivial solution 
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V = is destabilized under the influence of some biologically admissible (hence bounded) perturbations. 
For this we would like to proceed as in the Euclidean case, that is, by looking for perturbations in the 
form of elementary plane waves, the superposition of which defines a periodic pattern in the space D (or 
M. 2 in the Euclidean case). 

Let us first recall the Euclidean setting. In this case plane waves are called planforms and have the 
general form e ik r where k is any vector in R 2 (the "wave vector"). Each planform is an eigenfunction of 
the Laplace operator A corresponding to a real eigenvalue 8 : 

Ae jkr = -||k||V k ' r , r e R 2 . 

The fact that the eigenvalue does not depend upon the direction of the wave vector reflect the rotational 
invariance of the Laplace operator. Moreover, a given planform e ik ' r is clearly invariant under translations 
in R 2 by any vector e satisfying the condition k • e = 2mr where n G 7L (it clearly docs not depend upon 
the coordinate along the axis orthogonal to k). It is an elementary but fundamental fact of Euclidean 
geometry that given any two vectors k l5 k 2 of equal length, we can define the periodic lattice C spanned 
in the plane by ei and e 2 such that k^ • = 2n8ij, and that any smooth function in the plane which 
is invariant under translations in L can be expanded in a Fourier series of planewaves e I ( mk i+ Tlk 2) r 
to, n £ 7L. Therefore in a suitable space of lattice periodic functions the spectrum of the Laplace operator 
is discrete with real eigenvalues of finite multiplicities, the corresponding eigenfunctions being planforms, 
and we can proceed to classical bifurcation analysis if the equations do not have additional degeneracies 
or singularities (this was the approach of [ ] for the analysis of visual hallucinations formation in the 
cortex) . 

Our aim is to apply similar ideas to the case when the problem is defined in the Poincare disc instead 
of the Euclidean plane. A first remark is that we cannot define a periodic lattice in D by just assigning 
two basic wave vectors (D is not a vector space). There exist however a large number of periodic lattices 
in D. Those are defined by discrete subgroups of SU(1,1), and there are many such groups (called 
Fuchsian groups, see above) . We may therefore consider functions which are invariant under the action of 
a Fuchsian group. Thanks to their invariance under the action of U(l, 1) we know that our equations can 
be restricted to such functions. Moreover, if the fundamental domain of a Fuchsian group is compact (see 
above) , it is known that the Laplace-Beltrami operator restricted to this class of functions has a discrete 
spectrum of real eigenvalues with finite multiplicities. However before we go further in this direction, 
we first need to analyze the effect of perturbations in the form of elementary waves, the hyperbolic 
counterpart of planforms. 

Such hyperbolic plane waves have been introduced by Helgason [39] and are defined as follows: Let 
b be a point on the circle dD, which we may take equal to b\ — 1 by a suitable rotation. For z 6 D, 
we define the "inner product" (z,b) to be the algebraic distance to the origin of the (unique) horocycle 
based at b going through z. This distance is defined as the hyperbolic (algebraic) length of the segment 
0£ where £ is the intersection point of the horocycle and the line (geodesic) Ob, see figure 4. Note that 
(z, b) does not depend on the position of z on the horocycle. In other words, (z, b) is invariant under the 
action of the one-parameter group N (see definition above) . One can check that the functions 

are eigenfunctions of the Laplace-Beltrami operator A in D with eigenvalues —A 2 — 1. Helgason [39] used 
these functions to define the Fourier transform in D pretty much like the elementary functions e* Xlc '", 
x, u; £ R 2 , \\ui\\ = 1, are used to define the usual Fourier transform in the plane. We now define the 
Helgason hyperbolic planforms (or H-planforms) as the functions e\^b with A £ R or A = a + i, a £ K.. The 
first case corresponds to a real eigenvalue of A. In the second case, the eigenvalue is complex and equal 
to -a 2 - 2ia. The reasons for introduction of these H-planforms will become clear from the following 
properties: 



k|| is the Euclidean norm of the vector k. 
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Figure 4. The horocyclic coordinates of the point z of D are the real values s and t such 
that z = n s a t ■ O. The horocycle through z is the circle tangent to 3D at bi and going through z. 
(z, bi) is equal to the (hyperbolic) signed distance ^(O, a t ■ O) between the origin and the point a t ■ O 
which is equal to t and is negative if O is inside the circle of diameter (O, at ■ O) and positive otherwise. 

(i) they are by construction invariant under the action of the subgroup N (i.e. along the horocycles 
of base point 61). They correspond therefore to wavy patterns along the geodesies emanating from 
b\. These geodesies are parallel to each other and orthogonal to the horocycles. In that sense, 
these patterns are hyperbolic counterparts of the Euclidean planforms which correspond to trains 
of waves orthogonal to parallel straight lines in the plane (geodesies for the Euclidean metric) . 

(ii) Let us express z G D in ''horocylic" coordinates: z — n s a t ■ O, where n s are the (parabolic) 
transformations associated with the group JV (s £ 1) and at are the (hyperbolic) transformations 
associated with the subgroup A (t € R), see definition above and figure 4. 

It is readily seen from the definitions and formula (8) that (n s at ■ O, b±) = t. Therefore, in these 
coordinates, the H-planforms with base point b\ read e\ t b t {z) = e^ lA+1 '*. In particular if A = a + i, 
then e a+i ^ 1 is periodic with respect to the coordinate t with period 2n/a. Of course the same 
property holds at any base point b by simply rotating the planform by the angle (61,6). The H- 
planform is said to be periodic in this case. Figure 5 shows the pattern of a periodic H-planform. 
If A € R, the eigenfunction is not periodic due to the factor e* in front of e lXt . It does however 
correspond to a physically relevant wavy pattern in the sense that its " energy density" is expressed 
as e\^ 1 (t)e-xb! (t)e~ 2t dt = dt and is therefore bounded (here we applied the expression e~ 2t dtds 
for the surface element in horocyclic coordinates, see [39]). 

We now proceed with the linear step of our bifurcation analysis. 
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Figure 5. A periodic H-planform e a+ i y b 1 . The color represents the value of the magnitude of 
e a+i,b 1 ( z ) for z varying in D. The periodicity is to be understood in terms of the hyperbolic distance 
d.2- The hyperbolic distance between two consecutive points of intersection of the, say yellow, circles 
with the horizontal axis is the same. It does not look so to our "Euclidean" eyes and the distances look 
shorter when these points get closer to the point b\ on the right and to the point 6_i of 3D on the left. 
These points are actually at an infinite distance from the center O of D. 

The eigenvalue problem for equation (16) 

The linearisation of equation (16) at the trivial solution V = 0, with no input and with I'lflxK^R, 
reads 

V t {z,t) = -V(z,t) + h [ w{z,z')V{z' ',T)dm{z') (19) 
Jd 

where fx — S' o (0) and dm(z') is the "hyperbolic" measure in D defined in equation (17). Since equation 
(16) is invariant with respect to the isometries of D, we can look for solutions which are invariant under 
the action of the subgroup N. It is then appropriate to express z, z' 6 D in horocyclic coordinates: z — 
n s at ■ O, z' — n s :a t i ■ O. The hyperbolic surface clement in these coordinates is expressed as [39] 

dm(z') = e~ 2t ' dt' ds' (20) 

The invariance then reads 

V(n s a t ■ O) = V(at ■ O), for all (s, t) e R 2 (21) 

The integral term in (19) defines a linear operator, noted L, on the set of average membrane potential 
functions V, which can be expressed as follows (the last identity following from the change of variable 
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s' — s = xe 2t and the relation atn x = n xe 2tat [39]): 

(L ■ V)(n s a t ■ O) = / / w(n s a t ■ O, n s ,a t , ■ 0)V{a t , ■ 0)ds' e~ 2t ' dt' 

w(a t ■ 0,n 3 >- s <H> • 0)V{a t > ■ 0)ds' 'e~ 2t ' dt' 



w(a,t-t< ■ 0,n x ■ 0)dxj V(at> ■ 0)dt' 

This shows that L ■ V does not depend on the coordinate s (as expected). 

We have reduced the problem to an integro-diffcrential equation in the single coordinate t. Moreover, 
if we define 

u>(£) = / w(d£ • 0,n x ■ 0)dx 
Jr 

and assume that the integral is convergent for £ G R (this is the case with w defined by the function g in 
(3)), then equation (19) leads to the eigenvalue problem 

aV= -V + (xw*V (22) 

where ★ is a convolution product and we have set V(t) = V(a t ■ O). This problem can be solved by 
applying the Fourier transform in D which is defined as (see [39]): 

h(X,b)= [ h(z)eS- lX+1){z - b) dm(z) 

for a function h : D — > <D such that this integral is well-defined. Thanks to the rotational invariance we 
can restrict ourselves to the case b = b\ = 1, which gives, in horocyclic coordinates: 

h(\,b 1 )= [ [ h(n s afO)e ( - lX - 1)f dtds (23) 



Rotational invariance implies that the same equations would be obtained if an H-planform with another 
base point b were chosen. This can be seen directly on the expression of H-planforms from the relation 
(see [39]) 

e\,b( z ) = e \r v -b{r v ■ z), r v e K, z E D. 
It follows that for a given A and eigenvalue a. there is in fact a full "circle" of eigenfunctions e\.b, b € 3D. 



Bifurcation of periodic H-planforms 

We assume A = a + i in this section. This means that we are looking for solutions of (22) of the form 
e " 1 " e a +i t b 1 (z) = e" 1 ' e zat , net. The H-planforms are not only invariant along horocycles, but also 2ir/a 
periodic with respect to the coordinate t as shown above. If a bifurcation occurs with such a planform, 
the corresponding solutions of equation (16) will be s-invariant and i-periodic. We first look at the critical 
eigenvalue problem for such H-planforms. 

Applying the Fourier transform to (22) leads to the following expression for the eigenvalues: 

a (a) = -1 + fiw(a) (24) 

where w is the Fourier transform of w. Numerical calculation has been performed to compute w in the 
case when w is defined by the "Mexican hat" g given in (3)). Note that the function w is not even (hence 
the operator L is not symmetric). The following two properties of w are therefore not surprising 9 : (i) 
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Figure 6. Real (blue) and imaginary (red) parts of w denned in equation (24) for e a +i,b 
H-planforms, aeR, see text. We chose <j\ = 0.9, 02 = 1, = 0.6 and f(x) — x 2 in equation (3). 

the eigenvalues are complex in general, (ii) the graph of w shows maxima and minima. Figure 6 below 
shows the graph obtained with o\ = 0.9, eg = 1, 9 = 0.6, and / : x — > x 2 in equation (3). 

All eigenvalues come in pairs of complex conjugates and of course w{— a) — w(ct). The most unstable 
eigenvalues are those corresponding to the maximum of Re(ui), that is, in the case of Figure 6, with 
|a| = a c 0.76. The critical value p c of p is obtained by setting the real part of —1 + pw(a c ) equal to 
0. The corresponding critical eigenvalues are ±icu with loq = /i c Im(w(a c )) (with the parameter values 
of Figure 6, luq ~ 0.04 and p = fj, c « 0.65). When [i < fi c , small fluctuations around the trivial state 
of equation (16) are damped, while as \i crosses the critical value, perturbations with period 27r/a c will 
grow. In fact a continuum of wave numbers close to a c may also give rise to unstable modes, however 
we now restrict our analysis to functions which are T-periodic in t with period T = 2?:/a c . This allows 
us to reduce the problem to an equation bearing on functions U of the time r and the single variable t, 
which are square intcgrable in the interval of periodicity [0,T]. 

It follows that a Hopf bifurcation occurs from the trivial state of equation (1) at [i = \l c . Applying 
a procedure which is classical in the Euclidean case [22], we formulate the problem in operator terms as 
follows. Let p = /i — n c be close to 0, then 



dU 
It 



L Q -U + pLx-U+ C{U) + R(U, p) 



(25) 



where the operators Lq, Li and NL are defined as follows 



Lq-U = -U+n, c w-kU 
L x -U = w*U 



C(U) = ^w*U 3 , 



9 They would be false if the system were defined in the Euclidean plane instead of the Poincare disc, because in this case 
L would be a symmetric operator. 
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U 3 is the function (t, t) — » (U(t, r)) 3 , and R(U, p) stands for the higher order terms in U and p. These op- 
erators are defined in the Hilbert space T of square integrable, —-periodic functions T = L 2 (M/(— Z), IR). 
Lq and L\ are compact operators in T and NL, R G C°°{!F, T). The critical eigenvalues zLiujQ of Lo are 
simple. It follows from general Hopf bifurcation theory [ ] that a branch of periodic solutions bifurcates 
from the trivial state at p = fi c , i.e at p = 0, with a period 2it/uj where to is close to uiq, and the leading 
order of which has the form 

U (t) = e [e^ T+ ^e Qc+hbl + e^+^e^-j; 

where ip is an (arbitrary) phase. Plugging this into equation (25) and passing in Fourier space at the 
value a — a c we obtain the bifurcation equation 

iixi = iujQ + w(a c )ep — -w(a c )e 3 + h.o.t. 

from which it follows that 

e = ±2^p + 0(p) 

and w — u)q is readily deduced from this by taking the imaginary part of the bifurcation equation. The 
branching is therefore supercritical (for p > 0) and the bifurcated, periodic solutions are stable against 
perturbative modes which respect the symmetries of the solutions ("exchange of stability principle", [43]). 
At this stage however, no general stability statement can be made. 

One last remark should be made about these periodic solutions. In a suitable space of time-periodic 
functions (as chosen to perform the Hopf bifurcation analysis, see [22]) the invariance under time trans- 
lations of the problem induces a "temporal" symmetry by the action of the group S 1 = R/Z. This group 
simply acts by time shifts mod 2tt/uj (the time period of the bifurcated solutions). On the other hand, 
another copy of S 1 acts on (25) by shifts along the t coordinate mod 2ir /a c ("spatial" periodicity). These 
two groups act as follows on the leading term e 4 ( wr + Q ct) f ^he bifurcated solutions: 

(<P, ^jeS^SV e i(uT+<p+ ac t+i>) 

Therefore this term, which is also the complex eigenmode for the linear part of the equation, is fixed 
under the action of the one-parameter subgroup of 5* 1 defined by setting ip = —if;. By the general theory 
of Hopf bifurcations with symmetry [ ]), this property propagates to the full solutions of (25). The 
interpretation is that, for an observer moving along the t coordinate with velocity —uj/a c , the solution 
looks stationnary. Solutions which have this property are called relative equilibria [29], [22], and in the 
present case they can also be named H-traveling waves. These solutions resemble a train of H-planforms 
propagating from the "source" at infinity which is the tangency point b of the horocycles, see movie in 
supplementary material. 



Bifurcation of periodic patterns in D 

In the previous section we found bifurcated solutions which were periodic along the geodesies emanating 
from a point at infinity (i.e. on dD) and invariant along the orthogonal direction (that is, along the 
horocycles). This pattern corresponds to the Euclidean "strip" or "roll" pattern, with the noticeable 
difference that the latter are usually steady, while in our case they are uniformcly traveling from the 
source at infinity. Is it possible to go further in the analogy with the Euclidean case? Is it possible to 
find bifurcating patterns which are invariant with respect to a periodic lattice (or " tesselation" ) in D, 
in other words patterns which are invariant under the action of a discrete subgroup T of U(l,l) with 
a compact fundamental domain. This would be of physical relevance because it would correspond to 
bounded states. Moreover periodic tilings with certain types of compact "tiles" related for example to 
the groups T n x may be specially relevant to our problem as described above. 
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However the occurence of such groups and the requirement of compactness of their fundamental 
domain obeys very strict rules. In particular, an important difference with the Euclidean tilings is that 
fundamental polygons for a given group have a fixed area: applying some rescaling to the domain will in 
general destroy the tiling property. 

In any case, it results from general spectral theory on the hyperbolic plane that the spectrum of 
the Laplace-Beltrami operator restricted to T-invariant eigenfunctions, T with a compact fundamental 
domain, is discrete and its eigenvalues have finite multiplicity [33, 45]. Any smooth (square integrable) 
T-invariant function (or "automorphic function") in D can be expanded in a series of eigenfunctions of 
A. These eigenfunctions can be expressed in terms of e\j, H-planforms (A € K) as follows: 



^x(z) = f e {lX+1){z > b) dT{b) 

JdD 



where T is a distribution defined on the boundary dD of the unit disc D which in addition satisfies 
certain equivariance relations with respect to the action of T on dD. Here is an eigcnfunction for the 
eigenvalue —A 2 — 1, but the values of A depend on T and there is no known simple or explicit way to 
compute these values and the corresponding distribution T. 

We can nevertheless determine the threshold at which perturbations along the elementary H-planforms 
e\ jj will lead to instability of the trivial state for equation (19). The method is completely similar to the 
one for periodic H-planforms. The eigenvalues are given by equation (24). Figure 7 shows an example of 
the function w{\). As expected it takes only real values corresponding to the fact that the eigenvalues 
are real in this case. The most unstable eigenvalue corresponds to the maximum of the blue curve, the 
corresponding abscissa being the "critical" wave number A c . The critical value of the parameter /i is 
then defined by the relation = — 1 + /i c w)(A c ), for which all eigenvalues are negative but one, the critical 
eigenvalue, which is at 0. Therefore when fi crosses this threshold the system undergoes a steady-state 
bifurcation. The next question is to look for discrete groups T such that this critical value also corresponds 
to r invariant eigenfunctions. We have not carried out this program yet. 

The computation of the eigenvalues and T invariant eigenfunctions can only be achieved by numerical 
approximation. Only a few cases have been investigated in detail, for example the case when T is the 
octagonal Fuchsian group (see [3, 4]). This group, which we note r 8 , is spanned by four "boosts" 



(hyperbolic elements of SU(1, 1)) gu with go 



and <7fc = rk 2L gor_k JL , k 



l + y/2 + 
V2 + 2V2 1 + V2 

1,2,3. Its fundamental domain is the regular octagon which can define a tcssclation of D, as shown in 
Figure 8. 

In order to illustrate what an eigenfunction for the regular octagonal group does look like, we have 
computed one such eigenfunction following the method exposed in [4]. The result is shown in Figure 
9. Note the pattern which consists of pairs of blue and red spots uniformly distributed around the 
central octagon (which is materialized by a dark line as well as the image under the generator go of this 
octagon). This pattern is reproduced at infinity toward the boundary of the disc (which, in hyperbolic 
geometry, is at infinity) by acting with the elements of . In this figure the resolution becomes rapidly 
bad when approaching the boundary, but in Figure 10 we show a magnification of the sector in which 
the transformed octagon under go lies. In this figure we can nicely see how the pattern inside the central 
octagon has been transformed under go- If one is interested in the interpretation of these images in terms 
of structure tensors rather than in terms of points in the Poincare disk, one can use the U D to Tensor 
dictionary" defined by equations (11). As an example, looking at figure 10, we see that the centers z and 
z' of the red and blue blobs in the "main octagon" are symmetric with respect to the horizontal axis and 
such that z — 0.55 + 0.1 i and z' = 0.55 — 0.1 i. This corresponds to the two structure tensors 



T 



3.51 0.29 
0.29 0.31 



r 



3.51 -0.29 
-0.29 0.31 
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Figure 7. Real (blue) and imaginary (red) parts of w defined in equation (24) for e\.b 
H-planforms, Aef, see text. We chose G\ = 0.8, cr<z = 1, 6 = 0.7 and f(x) = x 2 and f(x) = x 2 in 
equation (3). 

whose distance is equal to 0.81. 

We should now take into account the symmetry group of the octagon, isomorphic to the dihedral 

dcf 

group Z?8 which contains 16 elements generated by the rotation r — til and by the reflection n through 
an axis of symmetry of the octagon. These transformations are all elements of U(l, 1). The fundamental 
domain of D s in the octagon is l/16th piece of the cake. It follows from the calculations of [4] that the 
eigenvalues of A in this fundamental domain (with suitable boundary conditions) are simple, therefore 
the eigenvalues in the octogon with suitable periodic boundary conditions are either simple or double 
depending on the way in which the rotation r acts on these eigenvectors. From the bifurcation point of 
view, this means that we may look for solutions in D which are invariant under the action of T$ and 
which transform like these eigenvectors under the action of -Dg, henceforth reducing the problem to a 
simple or double eigenvalue problem with Dg, symmetry. 

The theory of D n symmetry breaking bifurcations (n an integer) is well established, see [36]. We list 
below the generic situations which can occur according to the type of action of rotations and reflections 
in Dg on the eigenvectors at a critical parameter value. We show in table 2 the generic bifurcations of 
Tg-periodic patterns. We note £ an eigenvector of the Laplace-Beltrami operator A at a critical parameter 
value. Note that the octagon has two different types of symmetry axes: those joining opposite vertices 
and those joining the middle of opposite edges. The first case corresponds to points which are fixed under 
the reflection k (or a conjugate of k in -Dg). The second case corresponds to points which are fixed under 
the reflection «' = r^Kr^ (or a conjugate of k' in Dg). 

Note that the periodic pattern illustrated in Figure 9 corresponds to what a bifurcated state would 
look like in the case of the second line of table 2. 

We are however unable at this stage to tell without further and quite involved computations, which 
type of symmetry breaking will occur as the parameter \i crosses the stability threshold. 
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Figure 8. The fundamental domain of the octagonal Fuchsian group and the tesselation of 
D it generates. Two adjacent octagons are colored in different hues. 

Discussion 

Our investigations are somewhat related to some of the issues raised by Ermentrout [25]. They are also 
related to the work of Bressloff, Cowan, Golubitsky, Thomas and Wiener [18, 19] on a model where 
either the connectivity kernel w does not depend at all on the image features or is only sensitive to the 
(local) direction of the lines in it. This has led to beautiful results on the "spontaneous" occurence of 
hallucinatory patterns under the influence of psychotropic drugs. In further studies, Bressloff and Cowan 
have attempted to extend the theory to models taking into account not only the directional feature 
but also the spatial frequency in the images [17, 16, 15]. Based on the experimental observation that 
hypercolumns seem to be organized around "pinwheels" in the visual cortex (points at which neurons 
are sensitive to any direction), they derived a model where direction and frequency define a point on the 
unit sphere S 2 and the connectivity kernel is invariant under the group SO(3) of rotations of the sphere. 

Our approach differs in that we model edges and textures simultaneously at a given scale through 
the structure tensor. The underlying feature space and its transformations are more complicated than 
the sphere S 2 and its rotation group SO (3). We showed that they can be represented by the Poincare 
disk and its group of hyperbolic isometries. This naturally leads to a model of visual edges and textures 
where the equations are invariant by isometries in the (hyperbolic) space of structure tensors. Spatial 
scale can probably be included as well, this is the subject of future work. 

There are also connections between our work and some previous work by Bcn-Shahar, Zucker and 
colleagues [G] who discuss the representation and processing in VI of a larger set of visual features includ- 
ing edges, textures, shading, stereo. They do not deal at all with the problems of group invariance and 
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Figure 9. An example of an H-planform that is invariant with respect to the octagonal 
Fuchsian group. We have superimposed two fundamental domains: in the center the 
"main" one containing the origin, to its right another fundamental domain that shows the 
Euclidean distorsion due to the increase in the hyperbolic distance. In effect these two 
octagons can be exactly superimposed through the action of a hyperbolic isometry. The 
color encodes the value of the H-planform, blue indicates negative values, red indicate 
positive values, green indicates values close to 0. 
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Figure 10. This is a zoom on the first "octant" in figure 9. It is at a higher spatial 
resolution than this figure for the second octagon, the one to the right of the "main" one 
and shows better the relationship between the intensity patterns within the two octagons. 
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of bifurcations of neural states, most likely because their underlying mathematical machinery, relaxation 
labelling [26, 41], cannot easily address these questions. Ben-Shahar and Zucker pursue these ideas of 
"good continuation" of the texture flow from a more engineering viewpoint in [8] and in [7] from the 
viewpoint of differential geometry as beautifully described in the book by Petitot [ ] and in some of his 
earlier papers [57]. It is clear that these complementary approaches should be brought together at some 
point and unified but this is the subject of future work. 

The previous analyses and results use the assumption that the average voltage V(T, r) is invariant 
with respect to the action of the subgroup N of SU(1, 1). Thanks to this hypothesis we were able to 
reduce the dimension of the neural mass equation (1) from 2 to 1 and to use classical Fourier analysis to 
describe the process of pattern formation and of bifurcation of the solutions. 

One may argue that the action of the subgroup N on the set of structure tensors does not have a 
natural interpretation, unlike that of K and A and, for that matter, that of r„ it . On the other hand 
the subgroup N features a very simple set of invariant functions, the H-planforms that can be used to 
represent the solutions of (1) that are invariant with respect to its action. As far as we know similar 
functions are not known for the groups r„. t whose action on the set of structure tensors does have a nice 
interpretation. This implies that the putative invariance of the average voltage V(T, r) with respect to 
this action would be most interesting to test through an analysis of the bifurcations of the solutions of 
(16) in the line of what we did for the group N but is currently hampered by the lack of good functions 
for representing these solutions. 

Another remark is that the "energy density" of these solutions tends exponentially fast to oo as t 
tends to — oo, due to the e~ 2t term in the expression of the hyperbolic surface element in horocyclic 
coordinates, see equation (20). Such solutions may therefore not be physically admissible. This objection 
drops out for the H-planforms of the form e^ 1+lX ^ z ' b ' > with A S K, as noted previously. Unfortunately one 
cannot carry out a simple bifurcation analysis for these H-planforms. 

On the other hand we have seen above that such H-planforms can be associated, in a non trivial way, 
to periodic patterns with respect to the action of a discrete subgroup of U(l, 1). This problem needs 
further investigation. The preliminary discussion about the octagonal group could a priori be transposed 
to many other kinds of hyperbolic patterns, and we do not know which one would be preferred, if any. 

These examples are a few among many of an analysis that would have important implications in 
terms of the actual neural representation of the structure tensor (and at bottom of the image intensity 
derivatives). For example, given a subgroup T of SU(1, 1), assume that the mathematical analysis of the 
bifurcations of the solutions of equation (16) that are invariant with respect to the action of T predicts the 
formation of certain patterns having the kind of symmetries represented by T. If such patterns can indeed 
be observed by actual measurements, e.g., optical imaging [37], then this would be a strong indication 
that the neural "hardware" is built in such a way that its state is insensitive to the action of T. For 
example, in equation (16), the state is the average membrane potential V(z,t). The observation of the 
above pattern formation would come in support of the hypothesis that V(-f-z, r) = V(z, r) for all elements 
7 of the group T, for all structure tensors z and for all time instants r. In other words, bifurcation theory 
and pattern formation can be considered as theoretical probes of various hypotheses about the neural 
organization of the brain, allowing to make precise predictions about the kinds of patterns that should 
be observed in the activity of real brains, and opening the door to the design of experiments to test these 
hypotheses. Specific examples of such groups are the groups T Ut T we gave a few examples of and the 
octagonal group T 8 discussed previously. 

The restriction to the hyperbolic plane instead of the three-dimensional space of structure tensors 
looks like an oversimplification, which should be only considered a useful first step. Our plan is to extend 
this analysis to the full tensor space, making use if necessary (and this will certainly be the case) of 
numerical simulations in order to get a better idea of the phenomenology. 

As mentioned in the Methods Section, it is natural to consider a spatial extension of our analysis that 
would analyze a spatial distribution of the kind of structure tensor hypercolumns that we have described 
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in this paper, see equation (4). This would lead in particular to an analysis of "hyperbolic hallucinatory 
patterns" that could be compared against those described in the work of Bressloff, Cowan, Golubitsky 
and collaborators [18, 19]. This requires first to better understand our a-spatial model and is the subject 
of some of our future investigations. 

One may also speculate what such an array of structure tensors would offer compared to an array of 
orientations. Even if this has not yet been worked out to our knowledge in the context of neural fields, 
it is likely that an array of orientations can support the perception of extended contours in an otherwise 
"flat" image, like a cartoon [28, 27]. This can be achieved by such connectivity functions as those that 
enforce the Gestalt law of good continuation. As mentioned above some of these ideas can be found in the 
work of Steve Zucker and his associates. An array of structure tensors would add to this the possibility 
of perceiving extended texture edges such as those encountered in natural images where sharp variations 
in the texture are likely to indicate boundaries between objects. This is certainly a very important area 
of investigation from the psychophysical, neurophysiological and mathematical perpectives. 

A final remark is that all this analysis assumes a perfectly invariant problem under the group of 
isometries in the space of structure tensors, a situation which is of course very unlikely, but which has 
the great advantage to allow for computations and to highlight fundamental properties and features of 
the problem at hand. A next step would be to look at the "imperfect" case in which symmetries are 
not perfectly satisfied, but this, even in the simplified context of the Poincare disc, may be a formidable 
challenge. 
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Supplementary text SI 

We describe the relation between SDP(2) and SSDP(2). 

By identifying SDP(2) with the quotient GL(2,M)/0(2), we see that it is also a homogeneous space 
of the Lie group GL(2,K) of 2 x 2 invertible matrices with real coefficients. It is useful to consider 
the symmetric space of special symmetric positive matrices SSDP(2) = SDP(2) n SL(2,R) = {A € 
SDP(2),deL4 = 1}. This submanifold can also be identified with the quotient SL(2, K)/SO(2), which 
is itself isomorphic to the hyperbolic space i?2- Here SL(2,IR) denotes the special linear group of all 
determinant one matrices in GL(2,M). Therefore SSDP(2) is a totally geodesic submanifold of SDP(2) 
[53]. Now since SDP(2) = SSDP(2) x M + , it can be seen as a foliated manifold whose codimension-one 
leaves are isomorphic to the hyperbolic surface H 2 . 

Supplementary text S2 

The Poincare half-plane model, noted TL, is obtained from the Poincare disk model by the mapping / 
such that 

tt ^ - z+l 

u = J( z ) = -l 7 

z — 1 

which is an isometry from D to the upper half- plane TL : {Im(z) > 0}. The distance between two points 
U, v! in TL is then easily obtained from the distance in D by setting z — /~ 1 (it) and z' = in the 

expression (7). This gives 

d 3 (u,u') = ^(/-HtO.rV)) = arctanh^4 ( 26 ) 

\u' — u\ 
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Geodesies in Ti are lines or circles orthogonal to the real axis. The surface element in H 2 is 

ds 2 — U2 2 (du 2 + du 2 ), 

if u = Ui + iu2- 

Supplementary text S3 

We describe a spherical model for the set SDP(2) of structure tensors. The constraint that the determinant 
of the structure tensor should be equal to 1 is unnatural since in a given image the values of the structure 
tensors determinants are likely to vary over a wide range. We saw that the set of structure tensors, SDP(2), 
was a foliated manifold whose co-dimension 1 leaves arc isomorphic to H 2 . We can also represent SDP(2) 
as the open unit ball of K 3 . 
Let 

r _ [ a c 
[ c b 

be an element of SDP(2) of determinant equal to ab — c 2 = d 2 > 0. The change of variables 

a + b a — b 

xo = — ^— xi = — ^— x 2 = c, 

indicates that all tensors of determinant equal to d 2 belong to the sheet of the hyperboloid of equation 



corresponding to positive values of xq. If we perform the stereoscopic projection of this sheet with respect 
to the point of coordinates (0, 0, —d) in the plane of equation xq = one obtains the open disc of radius 
d > 0. 

Consider now the subset of tensors with determinant less than or equal to 1 (0 < d < 1). For each d 
we have a one to one correspondence between the tensors of determinant equal to d 2 and the points of 
the open disk in the plane of equation x$ = centered at the origin and of radius equal to d, hence with 
the same open disk centered on the a;o-axis but in the plane of equation xq — 1 — d. This establishes a 
one to one correspondence between the tensors of determinant between and 1 (including these values) 
and the northern half open unit ball of center the origin. 

Consider next the subset of tensors with determinant greater than or equal to 1 [d > 1). The inverse of 
each such tensor has a determinant equal to < 1/d < 1. We have therefore a one to one correspondence 
between the set of tensors of determinant d 2 and the points of the open disk of radius 1 jd in the plane 
of equation xo — 1/d — 1 centered on the xo-axis. This establishes a one to one correspondence between 
the tensors of determinant greater than or equal to 1 and the southern half open unit ball of center the 
origin. 

Combining these two representations we obtain a one to one correspondence between the set SDP(2) 
of structure tensor and the open unit ball centered at the origin, see figure 11. 

This representation has the following nice property. If T is an element of SSDP(2), dT, d > is an 
element of SDP(2) with determinant d 2 . Let m be the point representing T and P that representing 
d T . An easy verification shows that the projection of p of P in the xo-plane is obtained by applying the 
homotcthy of center the origin and of ratio d to the point m. 

The Ricmannian structure of SSDP(2) is transported to the open unit ball as follows. Consider two 
structure tensors T\ and T 2 with determinants d\ and d\. Define Ti — jrTi, i — 1,2 that are in SSDP(2). 
The geodesic G(t) between 7[ and T 2 can be parameterized by [55] 

G : [0,1] -> SDP(2) such that Q(t) = T^V log ( r ^ 1/2 r2 T^ 2 
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det = d? 



/ 

det = d>2 




Xq = 1 



X2 



1 




det = oo 



Figure 11. The unit ball of M 3 is a model of SDP(2), see text in the supplementary 
material text S3. 

A simple algebraic manipulation shows that 



where Q(t) is the geodesic in SSDP(2) between T\ and T 2 . In the sphere model the corresponding- 
geodesic is obtained very simply as follows. Let mi and m 2 be the two points of the open unit disk 
centered at the origin in the plane of equation xq = (this is the representation of SSDP(2)). The 
geodesic between mi and m 2 is the circular arc going through mi and m 2 orthogonal to the unit circle. 
Let m t be the point of this geodesic representing G(t). When t varies from to 1, the point m t traces the 
geodesic arc between mi and m 2 . According to a previous remark, the projection in the (xi,X2) plane 
of the point Pt representing the tensor Q(t) is obtained by applying the homotethy of center the origin 
and ratio d(t) = di~'d 2 to m t and its xo-coordinate is 1 — d(t) if d(t) < 1 and l/d(t) — 1 if d(t) > 1. 

Supplementary text S4 

We prove the following proposition that is stated without proof in the Section Methods: 

Proposition. r 2 t is a Fuchsian group for all T ^ 0. T± t (respectively r 6 x) is a Fuchsian group if 
coshT > ^2 (respectively if coshT > 2). 

Proof. According to [48, chapter 2], in order to prove that T ntt is Fuchsian it is sufficient to prove that 
it is a discrete subgroup of SU(1,1). Since T„ :t is the free product of the two cyclic groups K n and 
At- Theorem 1 in [61] gives a necessary and sufficient condition for such a subgroup of SU(1, 1, ) to be 
discrete. We define X p = 2 cos p > 2. Rosenberger's first theorem states that a sufficient condition for 
a free group product G of two cyclic subgroups of SU(1, 1) is that there exist two generators U and V 
such that 




• Tr(U) = X p or Tr(Z7) > 2, Tr(V) = X q or Tr(V) > 2, 

• UV ^ ±Id when Tr(U) = Tr(V) = 0, 

• TiiUV- 1 ) < -2. 
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Let r 2vr /„ be the element of K n corresponding to the rotation of angle n/n, n = 2,4,6. It is clear that 
r„ jt is generated by the pair (r 27r /„, ay) and that T¥(r 27r /„) = A„ and Tr(ay) = 2 cosh i. On the other 
hand Tr(r 2vr /„(aT) _1 ) = A„ cosht which does not allow us to conclude. 

Consider the case n = 2 and note that K^^t is also generated by the pair ([/ 2 7 \V 2 ) = (r 7V ,r~ 1 a,T) = 
{r w ,r- w a T ). It is easy to check that Tr(C/ 2 T ) = A 2 = 0, Tr(V 2 T ) = A 2 coshT = 0, U 2 T V 2 T = a T + Id if 
T ^ and Tr(f/J(V r 2 T )- 1 ) = -2coshT < -2 for all Ts. 

Consider the case n — 4 and note that if^T is generated by the pair (Uj ,V±) = (r 7T /2,r^J 2 a T ) = 

(?V/2> ?~-7r/2&T)- It is straightforward to check that Tr(J/J) = A4, Tr(y 4 T ) = A 2 coshT = and that 
TriUKVl)- 1 ) = 2 cos coshT = -\/2coshT. Thus K 4 ,t is Fuchsian if coshT > y/2. 

Consider finally the case n = 6 and note that K &>t is generated by the pair (Uq , Vq) — (r v / 6 , r^ g a T ) = 
( r Tr/6, r -7r/2 a T)- It is straightforward to check that Tr(J7^) = A 6 , Tr(V 6 T ) = A 2 coshT = and that 
Tr(£/J(V 6 T )- 1 ) = 2 cos ?f cosh T = — cosh T. Thus X 6 , T is Fuchsian if cosh T > 2. □ 
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Tables 


Table 1. A glossary of mathematical notations 


OT~\"n/r\ TTT) \ 

SDP(2, K) 


Inc set ol two-dimensional symmetric definite positive real matrixes. 


O O T~\ T~i ( C\ TTT) \ 

SSDP(2, lR) 


rni i j- -C or\n/o tttA i i j_i i j • j_ 

The subset ot SDP(2,1R) whose elements have a determinant equal to 1. 


U(l,l) 


Inc indcnnitc unitary group oi two-dimensional complex matrixes that 




i * j. -i-i *i* -C 1 12 1 12 

leave invariant tnc scsquilmcar lorm |zi| — |Z2j . 


SU(1, 1) 


Ine subgroup oi U(l, lj wnosc elements nave a determinant equal to 1. 


f \ T /O TTT) \ 

GL(2,K) 


Ine group oi two-dimensional mvcrtiblc real matrixes. 


bL(2, IRj 


ihe special linear group ol two-dimensional real matrixes with determinant equal to 1. 


TT 1 / O TTT) \ 


The group ol buchdean translormations ol K . 


0(2) 


The group of two-dimensional real orthogonal matrixes. 


S0(2) 


The special orthogonal group of the real orthogonal matrixes with determinant equal to 1. 


D 4 


The symmetry group of a square. 


D 6 


The symmetry group of the hexagon. 


D s 


The symmetry group of the octagon. 


D 


The open disk of radius 1. 


dD 


The boundary of D, the unit circle. 


H 


The hyperbolic space. 



Table 2. Generic bifurcations of r 8 -periodic patterns. Each case in the table corresponds to an 
irreducible representation of the group Dg. 



Ds acts trivially on ( 


simple eigenvalue, transcritical branch of states 
with full Dg symmetry 


r ■ C = C, « • C = -C 
and k' ■ ( = — £ 


simple eigenvalue, pitchfork branch of rotationally 
invariant states with broken k, k' symmetry 


r ■ £ = — £ and either 
k ■ ( = — ( or k' ■ C = — C 


simple eigenvalue, pitchfork branch of states 

with partially broken rotational symmetry 

(since r 2 • ( = ( the state keeps a 4-folds symmetry) 


r ■ C — C where £' 
is not colinear to ( 


several subcases can occur, for example if r£' = — ( the problem is similar 
to one with Z? 4 symmetry breaking. 

The critical eigenvalue is double, rotational symmetry is broken and 
there are generically two pitchfork branches of bifurcated solutions: 
those which keep the symmetry under reflection n and 
those which keep the symmetry under k' 



